Beyond Unit Testing for Data Intensive Apps

Eyal Trabelsi

• thanks for watching, I am Eyal I live in Tel Aviv and work for Salesforce.
• and today I am going to talk to you about how to properly test data intensive apps.

What's Data Intensive App 📊

• Amount of data

• Complexity of data

• Data is changing frequently

Why Testing 🤨

• Find bugs

• Validate assumptions

• Simplier code

• Data is messy

Testing Strategies 🎮

• Unit tests

• Property testing

• Component tests

• Integration Testing

• Regression tests

• Data tests

Base

• Preventing, Finding, and Fixing Bugs On a Time Budget
• Example

Doctests

• https://www.hillelwayne.com/post/python-doctests/
• https://blog.startifact.com/posts/older/i-like-doctests.html
• https://stackoverflow.com/questions/361675/python-doctest-vs-unittest

Unit tests

• https://towardsdatascience.com/pytest-features-that-you-need-in-your-testing-life-31488dc7d9eb
• https://www.youtube.com/watch?v=fv259R38gqc

Property tests

• https://github.com/HypothesisWorks/hypothesis
• https://engineering.hexacta.com/testing-pandas-b65c0ea8a28es
• https://www.hillelwayne.com/post/contract-examples/
• https://hypothesis.readthedocs.io/en/latest/stateful.html
• https://hypothesis.readthedocs.io/en/latest/examples.html
• https://www.hillelwayne.com/post/property-testing-complex-inputs/

Regression tests

• nbval pytests
• tdda

Mock

• https://github.com/obspy/vcr
• https://blog.daftcode.pl/the-cleaning-hand-of-pytest-28f434f4b684
• https://medium.com/@light_khan/mock-testing-in-python-using-vcrpy-ff3eb05ae5ec
• https://github.com/spulec/freezegun
• https://github.com/lk-geimfari/mimesis
• https://github.com/joke2k/faker

Contract tests

• https://github.com/deadpixi/contract
• https://www.hillelwayne.com/post/pbt-contracts/

Data tests

• https://github.com/great-expectations/great_expectations

Others

• https://www.youtube.com/watch?v=GEqM9uJi64Q
• https://medium.com/@copyconstruct/testing-in-production-the-hard-parts-3f06cefaf592
• https://github.com/locustio/locust
• https://www.simform.com/functional-testing-types/#sanity
• https://www.simform.com/functional-testing-types/#sanity